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APPLICATION 



FOR 



UNITED STATES LETTERS PATENT 



SPECIFICATION 



TO ALL WHOM IT MAY CONCERN: 

Be it known that Enrico Dolazza, a U.S. citizen, residing in Boston, Massachusetts, has 
invented certain improvements in a SWEEPING SPATIAL FILTER SYSTEM AND 
METHOD of which the following description in connection with the accompanying drawings is 
a specification, like reference characters on the drawings indicating like parts in the several 
figures. 



SWEEPING SPATIAL FILTER SYSTEM AND METHOD 



CROSS-REFERENCE TO RELATED APPLICATIONS 

[0001] This application is related to the following U.S. applications, of common 
assignee, the contents of which are incorporated herein in their entirety by reference: 

[0002] "Adaptive Spatial Filter, " invented by Enrico Dolazza, U.S. Patent Application 
Serial Number 09/651,529; and, 

[0003] "Adaptive Spatial And Temporal Filter For Noise Reduction In Image 
Sequences," invented by Enrico Dolazza, U.S. Patent Application Serial Number 09/651,535. 

STATEMENT REGARDING FEDERALLY SPONSORED RESEARCH 
[0004] Not Applicable 

REFERENCE TO MICROFICHE APPENDIX 
[0005] Not Applicable 

BACKGROUND OF THE INVENTION 

[0006] The present invention relates to image filtering, and more particularly, to systems 
for and methods of spatial image filtering, wherein the filter response characteristics may be 
modified to meet the needs of the user. 

[0007] " Level and Window" concept - In digital radiography (DR), an acquired image 
may be characterized by a dynamic range that is significantly larger than the display system or the 
ability of the person viewing the image to resolve the image. Consider an acquired image with 
an exemplary dynamic range of 12 bits, i.e., 2048 intensity states. The resolution of the human 
eye is limited under the best conditions to only a few hundred grayscale levels. Typically, the 
human eye is limited to less than one hundred grayscale levels. The level and window concept 
maps a portion of the acquired dynamic range into a display system. For example, a display may 
have a dynamic range of 8 bits, or 256 grayscale states. Using the level and window concept, the 
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display would then map any arbitrary portion of the overall image dynamic range. The user may 
select which portion of the acquired image dynamic range is to be mapped to the display, or the 
range may be "swept" across the entire dynamic range while the user observes the display. The 
ability to view different portions of the dynamic range is useful to the user because certain 
aspects of the image may only be apparent in particular portions of the dynamic range, or they 
may be much more pronounced in those portions of the dynamic range. 

[0008] Subjects of x-ray images have varying degrees of contrast and physical size. One 
category of subjects (e.g., masses) are characterized by large physical size in the image (with 
respect to surrounding and overlapping structures that are of no diagnostic interest), but may 
have relatively constant contrast across the object (i.e., homogenous with respect to intensity 
level). These subjects may not be easy to discern within the x-ray image when the subject 
overlaps an object with high contrast characteristics. These subjects are characterized by 
relatively low spatial frequency components in the image, due to their physical size and constant 
contrast characteristics. Low-pass filtering of these subjects can therefore be used to differentiate 
them from overlapping objects having high contrast characteristics. 

[0009] Another category of subjects (e.g., instances of micro-calcification) has high 
contrast, but are characterized by physically small details that make them difficult to detect, 
regardless of the background. These subjects are generally characterized by wide-band and/or 
high spatial frequency components in the image. High-pass filtering of these subjects helps to 
discern the subjects from other objects by increasing the contrast of the subject with respect to 
surrounding and overlapping structures. Due to the wide-band nature of some of these subjects, 
however, a high-pass filter may also reduce useful information regarding the subjects. 

[0010] Prior art image filtering systems typically provide a fixed frequency response at a 
given point in time, depending upon the particular application for which the filter is being used. 
Some prior art image filters provide adaptive capabilities to optimize signal to noise 
characteristics of the image, but such filters are typically adaptive only to components of the 
image itself. One disadvantage to such prior art filtering systems is that a single, fixed frequency 
response filter can not clearly show all aspects of a particular image, as described herein. 
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[001 1] It is an object of the present invention to substantially overcome the 
above-identified disadvantages and drawbacks of the prior art. 

SUMMARY OF THE INVENTION 

[0012] The foregoing and other objects are achieved by the invention, which in one 
aspect comprises a method of providing a spatially filtered version of an image, where the 
associated filtering characteristics are continuously and dynamically varied in time, with little or 
no control required by an operator. The method provides the spatially filtered version of the 
image by selectively modifying image pixel amplitudes as a predetermined function of spatial 
frequency components of the image pixels. The method includes dividing an overall frequency 
range of the image into a plurality of constituent frequency ranges. The method provides, for 
each of the constituent frequency ranges, a spatial filter for receiving the image pixels and 
producing a filtered output representative of the spatial frequency components of the pixels that 
are within that constituent frequency range. The method further includes scaling each of the 
filtered outputs by a scaling factor specific to the associated spatial filter, so as to produce a 
scaled output. Finally, the method includes combining the scaled outputs to produce a composite 
output representative of the spatially filtered version of the image. 

[0013] In another embodiment of the invention, the constituent frequency ranges are 
defined by octaves, such that each constituent frequency range is one half as wide as the next 
larger constituent frequency range. 

[0014] In another embodiment of the invention, the constituent frequency ranges are 
substantially contiguous. 

[0015] In another embodiment of the invention, the constituent frequency ranges overlap 
one another. 

[0016] In another embodiment of the invention, each of the scaling factors is a function 
of time. 
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[0017] Li another embodiment of the invention, the scaling factors vary as a function of 
time so as to sweep a pass-band having a predetermined bandwidth across the overall frequency 
range, such that image components characterized by frequencies within the pass-band are 
enhanced or passed without substantial attenuation. 

[001 8] In another embodiment of the invention, image components characterized by 
frequencies outside of the pass-band are substantially suppressed. 

[0019] In another embodiment of the invention, image components characterized by 
frequencies outside of the pass-band are attenuated but not substantially suppressed. 

[0020] In another embodiment of the invention, the predetermined bandwidth varies as a 
function of time. 

[0021] In another embodiment of the invention, the scaling factors vary as a function of 
time so as to sweep two or more pass-bands. Each pass-band has a predetermined bandwidth, 
across the overall frequency range, such that image components characterized by frequencies 
within each of the pass-bands are enhanced, or are passed without substantial attenuation. 

[0022] In another embodiment of the invention, image components characterized by 
frequencies outside of the pass-band are substantially suppressed. 

[0023] In another embodiment of the invention, image components characterized by 
frequencies outside of the pass-band are attenuated but not substantially suppressed. 

[0024] In another embodiment of the invention, the predetermined bandwidth varies as a 
function of time. 

[0025] In another embodiment of the invention, the spatial filter produces a filtered 
output as a predetermined function of a neighborhood of pixels. 

[0026] In another aspect, the invention comprises a system for providing a spatially 
filtered version of an image by selectively modifying image pixel amplitudes as a predetermined 
function of spatial frequency components of the image pixels. The system includes a frequency 
divider for dividing an overall frequency range of the image into a plurality of constituent 
frequency ranges. For each of the constituent frequency ranges, the system further includes (i) a 
spatial filter that receives the image pixels and produces a filtered output representative of the 
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spatial frequency components of the pixels that are within that constituent frequency range, and 
(ii) a multiplier that scales each of the filtered outputs by a scaling factor specific to the 
associated spatial filter, so as to produce a scaled output. The system also includes a combiner 
for combining the scaled outputs to produce a composite output representative of the spatially 
filtered version of the image. 

[0027] In another embodiment of the invention, the constituent frequency ranges are 
defined by octaves, such that each constituent frequency range is one half as wide as the next 
larger constituent frequency range. 

[0028] In another embodiment of the invention, the constituent frequency ranges are 
substantially contiguous. 

[0029] In another embodiment of the invention, the constituent frequency ranges overlap 
one another. 

[0030] In another embodiment of the invention, each of the scaling factors is a function 
of time. 

[0031] In another embodiment of the invention, the scaling factors vary as a function of 
time so as to sweep a pass-band having a predetermined bandwidth across the overall frequency 
range, such that image components characterized by frequencies within the pass-band are 
enhanced or passed without substantial attenuation. 

[0032] In another embodiment of the invention, image components characterized by 
frequencies outside of the pass-band are substantially suppressed. 

[0033] In another embodiment of the invention, image components characterized by 
frequencies outside of the pass-band are attenuated but not substantially suppressed. 

[0034] In another embodiment of the invention, the predetermined bandwidth varies as a 
function of time. 

[0035] In another embodiment of the invention, the scaling factors vary as a function of 
time so as to sweep two or more pass-bands, each characterized by a predetermined bandwidth, 
across the overall frequency range. The image components characterized by frequencies within 
each of the pass-bands are enhanced, or passed without substantial attenuation. 
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[0036] In another embodiment of the invention, image components characterized by 
frequencies outside of the passband are substantially suppressed. 

[0037] In another embodiment of the invention, image components characterized by 
frequencies outside of the passband are attenuated but not substantially suppressed. 

[0038] In another embodiment of the invention, the predetermined bandwidth varies as a 
function of time. 

[0039] In another embodiment of the invention, the spatial filter produces a filtered 
output as a predetermined function of a neighborhood of pixels. 

[0040] In another aspect, the invention comprises a method of a spatially filtering an 
image, including providing a spatial filter for receiving an array of intensity values corresponding 
to the image, and for producing a plurality of filtered outputs. Each of the filtered outputs 
represents the intensity values that have frequency components within a predetermined frequency 
range. The method further includes scaling each of the filtered outputs by an associated scaling 
factor, so as to produce a plurality of scaled outputs. The method also includes combining the 
scaled outputs to produce a composite output representative of a spatially filtered version of the 
image. 

[0041] In another embodiment of the invention, each of the scaling factors is a function 
of time. 

[0042] In another embodiment of the invention, the scaling factors vary as a function of 
time so as to sweep a pass-band having a predetermined bandwidth across the overall frequency 
range, such that image components characterized by frequencies within the pass-band are 
enhanced, or passed without substantial attenuation. 

[0043] In another embodiment of the invention, image components characterized by 
frequencies outside of the pass-band are substantially suppressed. 

[0044] In another embodiment of the invention, image components characterized by 
frequencies outside of the pass-band are attenuated, but not substantially suppressed. 

[0045] In another embodiment of the invention, the predetermined bandwidth varies as a 
function of time. 
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[0046] In another embodiment of the invention, the scaling factors vary as a function of 
time so as to sweep two or more pass-bands, each having a predetermined bandwidth, across the 
overall frequency range. Image components characterized by frequencies within each of the 
pass-bands are enhanced, or passed without substantial attenuation. 

[0047] In another embodiment of the invention, image components characterized by 
frequencies outside of the pass-band are substantially suppressed. 

[0048] In another embodiment of the invention, image components characterized by 
frequencies outside of the pass-band are attenuated but not substantially suppressed. 

[0049] In another embodiment of the invention, the predetermined bandwidth varies as a 
function of time. 

[0050] In another aspect, the invention comprises a system for a spatially filtering an 
image, including a spatial filter for receiving an array of intensity values corresponding to the 
image, and for producing a plurality of filtered outputs. Each of the filtered outputs represents 
the intensity values having frequency components within a predetermined frequency range. The 
system further include a plurality of multipliers for scaling each of the filtered outputs by an 
associated scaling factor, so as to produce a plurality of scaled outputs. The system also includes 
a combiner for combining the scaled outputs to produce a composite output representative of a 
spatially filtered version of the image. 

BRIEF DESCRIPTION OF DRAWINGS 

[0051] The foregoing and other objects of this invention, the various features thereof, as 
well as the invention itself, may be more fully understood from the following description, when 
read together with the accompanying drawings in which: 

[0052] FIG. 1 A shows a bandpass response swept across the image spectrum as a 
function of time according to the present invention; 

[0053] FIG. IB shows a bandpass response swept across the image spectrum as a 
function of time without completely attenuating regions outside of the passband; 
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[0054] FIG. 1C shows a spectral response swept across the image spectrum as a function 
of time according to the present invention; 

[0055] FIG. 2 shows one preferred embodiment of a sweeping spatial filter system; 

[0056] FIG. 3 shows the frequency characteristics for an exemplary embodiment of the 
spatial filter of FIG. 2; 

[0057] FIG. 4 shows the spatial frequency response of the embodiment of FIG. 2 with 
exemplary scaling factors; 

[0058] FIG. 5 shows an exemplary control device for varying the values of the scaling 
factors; 

[0059] FIG. 6 shows another embodiment of the sweeping spatial filter system of FIG. 2; 

and, 

[0060] FIG. 7 illustrates the frequency spectra for various points of the filter system of 
FIG. 6. 

DESCRIPTION OF THE PREFERRED EMBODIMENTS 

[0061] As described herein for the Level and Window concept, it is often useful to sweep 
a reduced dynamic range window through the overall dynamic range. Similarly, it is often useful 
to sweep a modified frequency window (in the spatial domain) through the overall frequency 
range of the image. As used herein, the term "sweep" means to selectively shape the spectral 
response of a spatial filter. Sweeping may include being able to place a fixed spectral response 
anywhere within the image spectrum. Sweeping may also include moving a bandpass response 
across the image spectrum as a function of time, as shown in FIG. 1 A, wherein the response is 
shown at time tl at time t2 and at time t3. Sweeping may also include, as shown in FIG. IB, 
moving the primary pass-band of a passband response across the image spectrum as a function of 
time, such that frequency ranges where the pass-band was at some other time are not completely 
attenuated. FIG. IB also shows the response at different times tl, t2 and t3. Further, sweeping 
may include moving (i.e., sweeping) the response as shown in FIG. IB, while also changing the 
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shape of the response as a function of time, as shown in FIG. 1C. The responses in FIG. 1C are 
shown at times tl, t2 and t3. 

[0062] FIG. 2 shows one preferred embodiment of a sweeping spatial filter system 100, 
including a spatial filter 102 having an input 104 for receiving an array of intensity values that 
define the image. In one embodiment, the array of intensity values corresponds to a set of pixels 
that constitute the image, such that each pixel is characterized by an intensity value. In other 
embodiments, the image may be formed from regions of the image that are not pixelated, but are 
delineated in other manners known to those in the art. The spatial filter 102 includes a plurality 
of outputs 106. In FIG. 2, each of the outputs 106 is labeled at the spatial filter 102 with a label 
OUTi, where i is an integer from 1 to N, and N represents the number of outputs 106. Each of the 
outputs 106 is coupled to a multiplier 108, and each multiplier 108 also receives a scaling factor 
wi. A combiner 110 receives an output from each of the multipliers 108, combines them in a 
predetermined manner (described in more detail herein), and produces a composite output 112 
that represents the spatially filtered image. 

[0063] Each of the outputs 106 of the spatial filter 102 corresponds to a frequency range 
that lies within the overall frequency bandwidth of the image. Each output 106 thus includes the 
intensity values of pixels having frequency components that fall within the frequency range of 
that particular output 106. FIG. 3 shows the frequency characteristics for an exemplary 
embodiment of the spatial filter 102 with eight outputs 106. The overall frequency band 150 of 
the image is shown in the top graph, and the eight constituent frequency ranges 152 through 166, 
corresponding to the eight outputs 106, are shown below the overall frequency band 150. 

[0064] In general, the value of the scaling factor wi may be any real number greater than 
or equal to zero. When 0 > wi > 1, the multiplier 108 attenuates the output 106 (i.e., reduces the 
intensity). When wi = 1, the multiplier 108 passes the output 106 unchanged. When wi > 1, the 
multiplier 108 enhances the output 106 (i.e., increases the intensity). In some embodiments, the 
scaling factor wi may be a function of time, i.e., wi(t). The scaling factor wi (t) may be tailored 
to assume any value greater than or equal to zero as a function of time. The scaling factors, 
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whether static or a function of time, are generally independent of one another, although in some 
embodiments the scaling factors may be characterized by some amount of interdependence 

[0065] In one preferred embodiment, the combiner 1 10 adds the outputs of the 
multipliers 108, such that the composite output 1 12 is a simple sum of the multiplier outputs. 
When all of the scaling factors wi are equal to 1 in this embodiment, the image corresponding to 
the composite output 1 12 is essentially the same as the image corresponding to the input 104. 

[0066] The invention provides a versatile spatial frequency response across the overall 
frequency range of the image by varying the scaling factors wi with respect to one another. FIG. 
4 shows the spatial frequency response 170 of the embodiment of FIG. 2 with exemplary scaling 
factors as follows: wl = 1, w2 = 1, w3 = 2, w4 = 2, w5 = 3, w6 = 5, w7 = 5, w8 = 3. Although 
this example presents a filter architecture with eight scaling factors, any number of scaling 
factors maybe used. This example demonstrates a spatial filter that enhances higher frequencies 
of the overall frequency band 150 while passing the lower frequencies unchanged. By 
appropriately setting the scaling factors wi, the invention can produce any desired frequency 
response. Further, higher frequency resolution of the frequency response 170 may be obtained by 
increasing the number of filter outputs 106 and corresponding scaling factors wi. 

[0067] In one embodiment, several sets of scaling factors may be preset for convenient 
retrieval by the user. For example, as described herein, certain structures in an x-ray image are 
more easily distinguishable when a particular spatial filter response is utilized. One such preset 
of scaling factors may be optimized for finding masses. A user (e.g., a radiologist) could quickly 
choose a "mass" preset if conditions suggest a mass may be present. Similarly, a different preset 
of scaling factors may be optimized for finding micro-calcification structures, so that the user 
may select a "micro-calcification" preset to search for micro-calcification structures. Thus, 
during a single examination of an x-ray image, the user may choose several scaling factor presets 
during his or her examination of the image. 

[0068] In another embodiment, the user may be provided with a control device for 
varying the values of the scaling factors. The control device 300, an example of which is shown 
in FIG. 5, maybe similar to an audio equalizer available on many commercial sound systems. 
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The exemplary control device 300 includes a control element 302 for each of the scaling factors 
wi. In this example, the control device 300 includes five such control elements, labeled 302:1 
through 302:5, consistent with the embodiment of the invention shown in FIG. 6 (described 
herein). A user may tailor the spatial filter response in real time by manipulating such a control 
device, so as to maximize his or her ability to distinguish a particular subject within the image. 

[0069] In yet another embodiment, each of the scaling factors may be a function of time 
wi(t). In this embodiment, each function wi(t) may be predetermined, so that the user merely 
selects a particular preset group of functions wi(t) and initiates a sweep from some start time tl 
to an end time t2. In some embodiments, the user may have control of the variable t, so that he 
or she may progress the functions wi(t) (and thus, the filter response) from tl to t2 at whatever 
rate he or she desires. Control of the variable t may be bidirectional (i.e., the user may decrease 
as well as increase the variable t), so that the user can progress and regress the scaling functions 
wi(t). Progression/regression of the scaling functions wi(t) allows the user to more easily find the 
optimum filter response for a particular subject. The user can search for the optimum filter 
response by "sliding 1 ' the variable t back and forth, while observing the filtered image to discern 
the subject of interest from the background. Thus, by providing an image filter with frequency 
characteristics that are continuously and dynamically variable, the present invention enhances the 
detectability of subjects of interest within the filtered image. Subjects of interest that were 
obscure in a static image are more easily distinguishable from surrounding structures when the 
image is varied in the frequency domain. Further, the invention provides continuously and 
dynamically variable frequency characteristics via automatic processes (e.g., preset fixed scaling 
factors, preset scaling factors as functions of time, etc.) so as to require little or no operator 
intervention. 

[0070] Another preferred embodiment 200 of the present invention is shown in FIG. 6. 
The structure of this embodiment is described in detail in the copending U.S. Patent Application 
Serial Number 09/651,529. The embodiment shown in FIG. 6 includes four filter sections 202, 
204, 206 and 208. A first summer 210 subtracts the output of the first filter section 202 from the 
input of the first filter section 202 to produce a first intermediate output 212. A second summer 
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214 subtracts the output of the second filter section 204 from the input of the second filter section 
204 to produce a second intermediate output 216. A third summer 218 subtracts the output of the 
third filter section 206 from the input of the third filter section 206 to produce a third 
intermediate output 220. A fourth summer 222 subtracts the output of the fourth filter section 
208 from the input of the fourth filter section 208 to produce a fourth intermediate output 224. In 
FIG. 6, the filter section inputs, filter section outputs, and the summer outputs are labeled with 
small case letters a through h. FIG. 7 illustrates the frequency spectra Aa through Ah for each of 
the eight labeled locations. The frequency spectra of the four summer outputs 212, 216, 220 and 
224 (i.e., Ac, Ae, Ag and Ai), along with the output of the fourth filter section 208 (i.e., Ah) are 
shown with a circled label in FIG. 7. The frequency characteristics shown in FIG. 6 are 
conceptual only; although spectra are shown with finite roll-off at the band edges, ringing and 
other consequences of realizable filters are not shown. These five spectra (Ac, Ae, Ag, Ai, and 
Ah) are provided to five corresponding multipliers (226, 228, 230, 232 and 234, respectively), 
where they are multiplied by a corresponding scaling factor (wl, w2, w3, w4 and w5, 
respectively). The resulting five outputs are received by the combiner 246, where they are 
summed to form the composite output 248. 

[0071] The filter sections 202, 204, 206 and 208 operate to halve the bandwidth of the 
incoming frequency range. This may be seen in FIG. 7, where the output spectrum Ab of the first 
filter section 202 is approximately one half of its input, the overall frequency band Aa. 
Similarly, the output spectrum Ad of the second filter section 204 is approximately one half of its 
input, Ab; the output spectrum Af of the third filter section 206 is approximately one half of its 
input, Ad; and, the output spectrum Ah of the fourth filter section 208 is approximately one half 
of its input, Af. 

[0072] The invention may be embodied in other specific forms without departing from 
the spirit or essential characteristics thereof. The present embodiments are therefore to be 
considered in respects as illustrative and not restrictive, the scope of the invention being 
indicated by the appended claims rather than by the foregoing description, and all changes which 



13 



BST99 1189186-2.056229.0098 



ANAK-200 



1 

I- t 

come within the meaning and range of the equivalency of the claims are therefore intended to be 
embraced therein. 
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